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CONDITIONS  FOR  THE  CONVERGENCE  IN  DISTRIBUTION 
OF  MAXIMA  OF  STATIONARY  NORMAL  PROCESSES 

by 

M.R.  Leadbetter,  G.  Lindgren,  and  If.  Rootz^n 
1.  INTRODUCTION 

Let  {£  }” be  a stationary  normal  sequence  with  zero  means,  unit 

variances  and  covariances  r = E(£  E ),  and  put  M = max  £ . If 

T c T n l<t<n 

r^  = 0,  t ^ 0,  i.e.  if  the  variables  are  independent  then 

-x 

(1.1)  P(a  (M -b  ) < x)  -*•  e e , n -*>  ®, 

n n n - 

where  a = /2  log  n and  b = a - A a {log  log  n + log  4ir}.  This  result 

goes  back  to  Fisher  & Tippet  (1928).  The  same  conclusion  was  obtained  under 

successively  weaker  dependence  restrictions  by  Watson  (1954),  Loynes  (1965), 

and  Berman  (1964).  Berman’s  result  is  that  if  either  (i)  r^  log  n -*■  0 as 

n -*■  °°,  or  (ii)  Z _r^  < “ then  (1.1)  holds.  Mittal  & Ylvisaker  (1975)  con- 
n*=0  n 

sidered  a somewhat  weaker  version  of  (i)  (in  the  vein  of  (2.2')  below)  and 

from  their  paper  it  can  be  seen  that  (i)  is  rather  close  to  what  is  possible: 

if  e.g.  r^  log  n y > 0 then  a different  limit  law  holds.  Nevertheless 

neither  of  (i)  and  (ii)  implies  the  other  in  general,  and  the  precise  relation 

between  the  conditions  is  not  obvious. 

For  a standardized  stationary  normal  process  {£( t),  in 

continuous  time  with  covariance  function  r(x)  = E(£(t)  £(t+x))  the  asymptotic 

behaviour  of  M(T)  ■ max  £(t)  depends  not  only  on  the  rate  of  decay  of 

0<t<T 

*(t)  as  T 00 , but  also  on  the  local  behaviour  of  r(t).  If 

(1.2)  r(T)  - 1 - C|x|a  + o(|T|a),  X -*•  0, 

where  C is  a constant  (or,  more  generally,  a function  of  slow  growth) 

and  0 < a < 2 then  there  is  a version  of  £(t)  which  has  continuous 

sample  paths,  and  if  r(t)  decreases  quickly  enough,  then  for  this  version 

-x 
-e 


(1.3) 


P(aT(M(T)-bT)  < x)  e 


T 
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where  aT  = log  T and  bT  = aT  + aT 1 { (^  - -j)log  log  T + 

+ log[(21T)  *^C  2^  a^^a]}.  This  has  been  proved  under  various 

conditions  by  Rozanov  & Volkonski  (1959),  Cramer  (1965),  and  Berman  (1971a) 
for  a =•  2 and  by  Pickands  (1969)  and  Berman  (1971b)  for  0 < a < 2. 

Pickands  and  Berman  assumed  in  addition  to  (1.2)  either  of  the  two  conditions 
(i')  r(t)  log  t -*■  0 as  t -*■  »,  or  (ii')  /r(t)^  dt  < 00  (or  / r(t)p  dt  < 
some  p > 0) . Again,  neither  one  of  (i * ) and  (ii*)  implies  the  other. 

In  the  present  note  we  consider  conditions  which  are  weaker  than  (i) 
and  (ii)  (or  (i')  and  (ii'))  but  which  still  imply  that  (1.1)  or  (1.3) 
holds.  These  conditions  seem  to  contain  more  of  what  is  essential  for  (1.1) 
and  (1.3)  and  will  also  clarify  the  relation  between  (i)  and  (ii)  and  between 
(i ' ) and  (ii * ) . We  treat  the  discrete  time  case  in  Section  2 and  the  con- 
tinuous time  case  in  Section  3. 

2.  DISCRETE  TIME 

In  this  section  we  shall  show  that  the  condition 

(2.1)  n * E |r,  | log  k e^rk^°8  ^ o,  as  n -»•  °°, 

k=l 

for  some  y > 2,  together  with  r -*■  0 is  sufficient  for  (1.1)  to  hold. 
Essentially  Condition  (2.1)  prevents  rn  log  n from  being  too  large 
too  often. 

Define  ©^(x)  = {k*  1 < k < n,  [r^l  log  k > x}  and  let  Vr(x)  be 

the  number  of  elements  in  0 (x) . The  content  of  Condition  (2.1)  can  be 

n 

further  elucidated  by  considering  the  following  slightly  stronger  condition 
-1  n 

(2.2)  n E | r.  | log  k -*■  0,  as  n -*■  00 , and 

k-1 

V (K)  * 0(rP)  for  some  K > 0,  n < 1, 
n 

and  the  equivalent  condition 
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(2.2')  V'n(e)  = °<n).  V e > 0,  and 

Vn<K)  * OCn^)  for  some  K > 0,  n < 1. 

• . • oo  * . p 

Obviously  (i)  implies  (2.2*).  Further,  if  Ek_jJrk|  < " for  some  p > 0 

then,  since  2k=^ I rk I ? - ^0  (x)lrk^P  - vn^xHx/log  n)P,  it  follows  that 

n 

\>n(x)  = 0((log  n)p).  In  particular,  taking  p = 2 we  see  that  also  (ii) 
implies  (2. 2'),  so  that  both  (i)  and  (ii)  are  stronger  than  (2.2)  and  (2.2’). 
The  following  lemma  states  that  (2.2)  or  (2.2r)  imply  (2.1)  and  consequently 
that  both  (i)  and  (ii)  imply  (2.1). 


LEMMA  2.1  If  r 0 as  n -*  <*>,  then  (2.2),  and  (2. 2')  both  imply  (2.1). 


PROOF  It  is  easily  seen  that  (2.2)  and  (2.2‘)  are  equivalent  so  we  need 
only  show  that  (2.2)  implies  (2.1).  We  have 


(2.3) 


n 2 lrkl  log  k e 
k=l  * 


Y|r Jlog  k 


-1  * -1  „ , ,,  . Y|rk!logk 


n 2 | r,  | log  k e 

l<k*n 
k*8n(K) 

-1  , ■ Y|rk|log  k 

+ n 2 | r.  | log  k e 

k£0n(K) 


and  proceed  to  estimate  the  sums  in  the  right  member  separately,  assuming 
that  (2.2)  holds.  Now 


“!  E I rkl  log  k e 

k=l  K 

k?6n(K) 


Y| rfc| log  k 


- eYK  n z I rk  I log  k 0 » 
k=l 


n -*•  °°, 


by  the  first  part  of  (2.2).  Since  we  assume  that  r^  0,  there  is  an  integer 

N such  that  y|rkl  < ( 1 — n ) / 2 for  k > N.  Hence 

— 1 Y|  *1,  | log  k ^ 1 y.  \ / O 

n 2 jr.  | log  k e < n v (K)  log  n n ^ , 

k€8  (K)  K - n 

n 

k>N 

which  tends  to  zero  as  n -*■  08 , by  the  second  part  of  (2.2).  As  N is  fixed, 

M 1 N 

n 2k-1|rk|log  k exp(y|rk|log  k)  0,  and  it  follows  that  also  the  second 
term  of  the  right  hand  side  of  (2.3)  tends  to  zero,  and  thus  that  (2.1)  is 
satisfied.  c 
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Even  if  (2.1)  is  weaker  than  (2.2)  this  is  only  by  a slight  margin. 

In  fact,  n-1£"=1|rk|log  k < n"1^ | rfcl log  k exp(y|rk|log  k) , so  if 

(2.1)  holds  then  n'^^jrj  log  k 0 which  in  turn  implies  that 

v (e)  * o(n) , Ve  > 0. 
n 

THEOREM  2.2  If  r ■+  0 as  n ■+■  00  and  (2.1)  is  satisfied  then  (1.1)  holds, 
--  ■ - n 

i.e.  the  distribution  of  the  (normalized)  maximum  converges  to  the  double 
exponential  distribution. 

As  is  shown  in  Berman  (1964)  we  only  have  to  prove  the  following  lemma 
to  obtain  the  theorem.  We  use  the  notation  of  Leadbetter  (1974). 

LEMMA  2.3  Suppose  that  satisfies  the  hypothesis  of  Theorem  2.2,  and 

let  u = x/a  + b . Then 
n n n 

n -u2/(l+|r  |) 

(2.4)  n £ |rk|e  0 as  n «. 

k=l 

PROOF  We  only  indicate  the  changes  which  have  to  be  made  in  [5]  p.  22 
(or  in  [1]  p.  510).  As  is  shown  there 


(2.5) 


-u2/2 

e n ~ Ku  /n»  (n  ■*  °°) 
n 


ufi  ~ (2  log  n)  , (n  -*■  °°) 

(a  ~ b means  a = b(l+o(l)))  where  K is  a constant,  whose  value  below 

may  change  from  line  to  line.  Further  6 = sup(r  | <1.  Put  8 = 2/y  and 

n>l  "_6 

let  a be  a constant  such  that  0 < a < min(8»  -j^j) . 

Split  the  sum  in  (2.4)  into  three  parts,  the  first  for  1 < J < In  J, 

the  second  for  [naJ  < j < [n  ] and  the  third  for  [n  ] < j 5 n.  In  [5] 

it  is  shown  that  the  first  sum  tends  to  zero. 

Next,  define  6 = suplr  I and  note  that  6 -*■  0 as  n -*■  00 . Now 

n . m n 

writing  p = tn  ] and  q = tnP]  we  have  for  the  second  part  of  (2.4) 


J | , *UJ/<l+lrkl)  < 1+8  Un  Undo  < 8-12  6p'Jn 

n £ | r.  j e <ne  e ZK-nune 

k-p+l 

^ „ 0-12  26 
< K np  u n p , 
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which  tends  to  zero  by  (2.5).  0 

n 2 

Finally,  for  the  last  part  of  (2.4)  we  have,  using  e ~ ur/n  ~ 

~ (2  log  n)^2/n. 


-u„/a*|rkl) 


n -u2/(l.|tk|)  n 2/(H*kl) 

n E | r.  |e  n < Kn  E |r,  |(u  /n)  < 

k“q+l  k=q+l  n 

-1  n , , 2|rk|log  n 

< Kn  log  n E | r,  | e 
k*q+ 1 

For  k > q we  have  log  k > 8 log  n,  and  hence  this  is  not  larger  than 

„ -1  ” . | . . 2/8 1 r.  | log  k -1  ! | | . Ylrk!log  k 

Kn  E |r,  | log  ke  1 k ' ® <Kn  Z | r.  | log  k e , 

k=q+l  K k=l 

where  we  have  used  2/8  = Y*  By  (2.1)  this  tends  to  zero  as  n which 

concludes  the  proof  of  (2.4). 


3.  CONTINUOUS  TIME 


For  a process  with  continuous  time,  the  constant  a in  the  local  covariance 
condition  (1.2)  influences  the  normalization  needed  to  obtain  the  limit 
law  (1.3)  for  the  maximum.  In  fact,  the  value  of  a also  affects  the  extent 
with  which  the  maximum  of  £(t)  over  an  interval  can  be  approximated  by 
the  maximum  over  a discrete  set  of  points.  Let  h(t)  be  any  function  and 


define 


(3.1) 


0T(h)  - { t ; 0 < t < T,  | r(t) | log  t > h(t ) } 
iT(h)  * A(0T(h))  * Lebesgue  measure  of  0T(h). 


In  analogy  with  the  conditions  for  discrete  time  we  will  place  restrictions 
on  the  amount  of  time  that  |r(t)|  log  t is  large  by  requiring  that  there 
is  some  function  h with  h(t)  +0  as  t + « such  that 

(3.2')  £T(h)  - 0(T/ (log  T)Y),  for  some  y > max(0,  1 - 1/a) 

and  some  constant  K > 0 such  that 


(3.2")  H^(K)  - O(T'),  for  some  n < 1. 
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I- 


Obviously  (i')»  i.e.  r(t)  log  t -*■  0 as  t -*■  00 , implies  that  0T(h)  is 

uniformly  bounded  in  T,  for  example  with  h(t)  = 2 sup|r(s)|  log  6,  so 

T _ s>t 

that  (i’>  implies  (3.2).  Further,  since  /Q|r(t)|pdt  > £T(h) (h(T) /log  T)  , 
(ii’),  i.e.  /q  r(t)2dt  < °°,  implies  that  ^(h)  * O((log  T/h(T))2)  for 
all  h,  so  that  also  (ii')  implies  (3.2). 

THEOREM  3.1  If  r(t)  -*-0  as  t *►  00  and  (3.2)  is  satisfied,  then  (1.3) 
holds,  i.e.  the  distribution  of  the  (normalized)  maxima  converges  to  the 
double  exponential  distribution. 

Following  the  routine  in  Berman  (1971)  and  Leadbetter  (1974)  we  need 
only  prove  the  following  lemma. 


LEMMA  3.2  If  r(t)  satisfies  the  hypothesis  of  Theorem  3.1,  if 
u = Uj,  = x/aT  + bT,  q = g(T)/(log  T)1^01,  where  g(T)  -*■  0 as  T -*■  «,  and 
if  the  convergence  of  g(T)  to  zero  is  slow  enough,  then 

(3.3)  - E |r(kq)|e~u  /<Hr(kq)l>  ^ 0 

q £5kq<T 

as  T 

PROOF  Let  6 ( t)  = sup|r(s)|,  let  $ satisfy  0 < $ < (l-<5(e))/(l+<5(e)) , 
s-t  8 

and  split  the  sum  in  (3.3)  into  two  parts  at  kq  « T,  i.e.  let  E'  be 

8 S 

the  sum  over  e < kq  < Tp  and  E"  the  sum  over  Tp  < kq  < T.  Since 


0(1) /T 


we  can  estimate  E'  simply  from  the  number  of  terms, 

If- 2 I . ir(kq)|e-"2/(1*l'(K,)l) 

q q e<kq5TtS 

T T6  -u2/(l+6(c))  ^ KTl+B-2/(l+6(e)) 

< — • — -e  < -+  0 

- q q - q2 

by  the  choice  of  8 and  q. 

For  the  remaining  sum  E"  we  need  a bound  on  the  number  of  terms 


for  which  |r(kq)|log  kq  is  not  bounded  by  a small  function.  Define,  for 
any  function  h. 


7 


n^,(h)  = # {k;  T < kq  < T,  |r(kq)|log  kq  > h(kq)} 

in  analogy  with  &T(h)  in  (3.1).  Since  r(t)  satisfies  a Lipschitz 
condition  at  0 it  does  so  uniformly  for  all  t.  In  fact,  if  a'  < mind,  a) 


| r(t+h)  - r(t) | < C|h|a  , 


see  Boas  (1967),  Theorem  1.  We  will  use  this  to  give  a bound  for  nT(h) 
in  terms  of  ^(h/2).  Let  y be  as  in  condition  (3.2)  and  take  a'  such 
that  a/(l+ya)  < a'  < min(l,  a).  Note  that  we  can  always  find  such  an  a' 
and  that  ^ - y < 0.  We  will  show  that  for  all  non-increasing  functions 


(3-4)  ttjXh)  < C’(log  T/h(T))1/a  £T(h/2), 

if  T is  large  enough.  Since,  for  t > kq,  jr(t)|log  t > (|r(kq)|  - 
ot1 

- c|t-kq|  ) log  kq  we  see  that  if 
| r(kq) | log  kq  > h(kq) 
and  t is  such  that 

“1  < ‘ < k<  * 


j r(t) | log  t > h(t)/2. 

We  have  q ■ g(T)/(log  T)1^01  and  thus  (h(T)/log  T)1//a  /q  = 

* ' g (l) — (l°g  T)  where  a > a'.  Since  we  have  a free  choice 

in  letting  g(T)  -*-0  as  slowly  as  necessary,  we  may  thus  assume  that 
1/a’ 

(h(T)/log  T)  q -*■  0 as  T This  implies  that  for  T large  enough 

the  kq  which  contribute  to  nT(h)  also  contribute  disjoint  intervals 
of  length  (h(T)/(2C  log  T))^a  to  tT(h/2),  and  we  get  (3.4)  with  c'  = 

- (1/2C)1/Ct’. 

We  can  now  proceed  by  splitting  the  sum  E"  according  to  if 

kq€0_(2K)  or  not.  Recalling  the  notation  6(t)  = sup|r(s)|,  we 

s>t 
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(3.5) 


I I"  -I  a E | r (kq) | e_U  /(1-lr(kq)|)  < 

<1  q Tg<kq<T 

< - ^(2K)e-“2/(1+6(lS))  * 


+ J 6 ^ 

q TP<kq<T,  kqeeT(2K)!( 


•(kq) | 


-u2(l-2K/log  T6) 


The  first  term  in  (3.5)  is  bounded  by 

-C'(log  T/2K)1/Ct'  l (K)  0(1)T~2/(1+6(tB))  < 

q T 

. r..  (log  T)1/a,+1/a  l+n-2/(l+6(TB)) 

< c — 6 gW) T 

Q 

Since  n < 1 by  (3.2)  and  6(T  ) 0 this  bound  goes  to  zero  as  T 

if  g(T)  -*■  0 slowly  enough. 

The  second  term  in  (3.5)  is  bounded  by 


(3.6) 


(Tj2e-u  (1-2K/(B  log  T)) 

q 


riog-r T Z I^Ocq)  (log  kq  = 


say,  where  the  sum  is  extended  over  all  kq  such  that  T < kq  < T and 
kq6  0T(2K)*.  We  will  see  that  F^  F£  -►  0 as  T -►  “,  but  that  F1*F2 

We  start  with  F^,  introducing  the  function  h that  appears  in  (3.2')  and 
split  the  sum  according  to  wether  kq £ 0T(2h)  or  not,  giving 


0. 


F.  = ^ £|r(kq) (log  kq  < 4 


E + f E 

T kq£0T(2h)*  kq£0T(2h)n0T(2K)* 

kq<T 


< 2h(T6)  + A.2KnT(2h)  < 2h(T0)  + 2KC'  *(log  T/h(T))1/a'£T(h)  = 

= 2h(T6)  + SUL—.  (i0g  T)1/a,"1/a_Y*0(l)  - 2h(T6)  + g(T)k(T), 

(h(T))l/0t 

say,  by  Condition  (3.2')  and  the  definition  of  g.  Since  l/cx,_l/ci-Y  < 0, 
we  can  deduce  that  k(T)  -*■  0 as  T -*•  «>,  provided  h(t)  decreases  sufficiently 
slowly.  Also  note  that  if  (3.2')  is  fulfilled  for  some  function  h,  then  it  is 
fulfilled  for  all  functions  which  decrease  more  slowly.  We  can  therefore  assume 
that  k(T)  ■+•  0 as  T «®.  The  remaining  factor  F^  in  (3.6)  is  given  by 
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/I\2  -u2(l-2K/(6  log  T))  1 

F1  * (q}  6 FlSF T • 

Using  the  fact  that 

u2  = 2 log  T + 2(i  - -|)log  log  T + 0(1) 

we  get 

0(1)  -2(l/ot-l/2)log  log  T _ 

F - ~2  e 

q log  T 

0(1)  M _.2/a-l-2(l/a-l/2)  0(1) 

= ~ (log  1)  = o • 

g(T) 2 g(T) 


■f2  < 0(1) 


2h(Tg)  k (T) 
g(T)2  g(T) 


where  k(T)  does  not  depend  on  g(T)  . Since  we  may  let  g(T)  0 

ft  2 2 

arbitrarily  slowly  we  obtain  that  h(T  )/g(T)  -*■  0 and  k.(T)/g(T)  ->-0  as 


T which  completes  the  proof  of  the  lemma. 


REMARK  3.3  As  in  discrete  time  one  would  be  inclined  to  consider  a condition 
like 

(3.7)  a E |r(k,)|logk,  eYlr<lq>|l°gl^0 

^ ft 
TP<kq<T 

as  T -*■  °°,  for  some  $ < 1,  y > 2.  We  can  presently  prove  that  (3.7)  can 
replace  (3.2)  at  least  if  a = 2.  However,  (3.7)  contains  the  somewhat 
arbitrary  spa?ing  q.  A. more  natural  condition  for  a continuous  time  process 
would  restrict  the  size  of 

/ |r(t)llog  t eU  nO  I l°g  t dt_ 

1 

How  this  sllould  be  done  in  relation  to  (3.7)  is  not  clear. 
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